Further Development of the Assessment of Military Multitasking Performance: Iterative Reliability Testing
نویسندگان
چکیده
The Assessment of Military Multitasking Performance (AMMP) is a battery of functional dual-tasks and multitasks based on military activities that target known sensorimotor, cognitive, and exertional vulnerabilities after concussion/mild traumatic brain injury (mTBI). The AMMP was developed to help address known limitations in post concussive return to duty assessment and decision making. Once validated, the AMMP is intended for use in combination with other metrics to inform duty-readiness decisions in Active Duty Service Members following concussion. This study used an iterative process of repeated interrater reliability testing and feasibility feedback to drive modifications to the 9 tasks of the original AMMP which resulted in a final version of 6 tasks with metrics that demonstrated clinically acceptable ICCs of > 0.92 (range of 0.92-1.0) for the 3 dual tasks and > 0.87 (range 0.87-1.0) for the metrics of the 3 multitasks. Three metrics involved in recording subject errors across 2 tasks did not achieve ICCs above 0.85 set apriori for multitasks (0.64) and above 0.90 set for dual-tasks (0.77 and 0.86) and were not used for further analysis. This iterative process involved 3 phases of testing with between 13 and 26 subjects, ages 18-42 years, tested in each phase from a combined cohort of healthy controls and Service Members with mTBI. Study findings support continued validation of this assessment tool to provide rehabilitation clinicians further return to duty assessment methods robust to ceiling effects with strong face validity to injured Warriors and their leaders.
منابع مشابه
Towards a Task-Based Assessment of Professional Competencies
Performance assessment is exceedingly considered a key concept in teacher education programs worldwide. Accordingly, in Iran, a national assessment system was proposed by Farhangian University to assess the professional competencies of its ELT graduates. The concerns regarding the validity and authenticity of traditional measures of teachers' competencies have motivated us to devise a localized...
متن کاملThe Simulation Module for Assessment of Resident’s Targeted Event Response (SMARTER-Shift): a novel teaching method in Emergency Medicine education
Background: Attention to several clinical issues simultaneously and timeliness of proper treatment is of prime importance in Emergency Medicine. Simulation Based Training is a growing trend for clinical resident training which has been proposed for enhancing of residents multi-tasking abilities. The Simulation Module for Assessment of Resident’s Targeted Event Response is a methodology which de...
متن کاملA Mixed-methods, Cross-sectional Study of Assessment Literacy of Iranian University Instructors: Implications for Teachers\' Professional Development
Professionalism requires that language teachers be assessment literate so as to assess students’ performance more effectively. However, assessment literacy (AL) has remained a relatively unexplored area. Given the centrality of AL in educational settings, in the present study, we identified the factors constituting AL among university instructors and examined the ways English Language Ins...
متن کاملThe Effect of Portfolio Assessment on the Development of Metadiscourse Markers Awareness in EFL Learners' Oral Performance
Portfolio assessment as one of the alternatives to testing is defined as the systematic collection of student work measured against predetermined scoring criteria. This paper aimed to investigate the effect of portfolio assessment in the oral performance of EFL learners in an attempt to examine its impact on their metadiscourse awareness. To determine the impact of portfolio assessment on the o...
متن کاملModeling in Early Stages of Technology Development: Is an Iterative Approach Needed?; Comment on “Problems and Promises of Health Technologies: The Role of Early Health Economic Modeling”
A recent paper by Grutters et al makes the case for early health economic modeling in the development of health technologies. A number of examples of the value of early modeling are given, with analyses being performed at different stages in the development of several non-drug health technologies. This commentary acknowledges the contribution of the paper by Grutters et...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره 12 شماره
صفحات -
تاریخ انتشار 2017